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ABSTRACT 



This invention is directed to a method and apparatus for 
producing video signal timing for a display device that has 
a display format different from the input video format. It also 
provides a method and apparatus for producing video signal 
timing in cases where the input video line rate and display 
output line rates are not the same. Furthermore, a method 
and apparatus are provided for synchronizing the display 
output line rate to the input line rate so that the source video 
line input rate can sustain the rate at which the input lines are 
processed to generate display video lines using a minimum 
amount of memory buffer for a variety of display processing 
methods. Another aspect of the present invention provides a 
method and apparatus for synchronizing display output 
timing to input video timing such that both are locked in 
terms of frame rate, but skewed in terms of frame phase, in 
order to accommodate latency incurred by processing of 
source video data to generate the display video data. A 
method and apparatus are also contemplated by this inven- 
tion for adjusting the skew between the input source video 
frame timing and the display output video from timing to 
accommodate latency for various types of display process- 
ing such as, but not limited to, scaling, video format 
conversion, and filtering operations. 

9 Claims, 33 Drawing Sheets 
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MULTI-SCAN VIDEO TIMING GENERATOR the time when the resulting processed data is available for 

FOR FORMAT CONVERSION output to the display device. It has also been common 

practice in some systems to process the data first before 

BACKGROUND OF THE INVENTION storing the data in the frame buffer. In either of these prior 

1. Field of the Invention 5 art processing scenarios, a display timing generator is pro- 
_ . . . i. , -j j- i . vided which operates at the desired display line and frame 
Tlie invenhon relates generally to video display systems, Mc and ^ hronizi si nal / to control the 

and more particularly to a method and apparatus for con- dis , M weU as the lransfef of sscd frame buffcr dala 

verting an input video signal of a first viewable dusplay tQ , he di h ^ dj , (imi , or oduces |jmi 

resolution, pixel rate, and line rate to a second output v.deo fof a differen , nufflber of ^ lfae ^ Une rate ^ , he 

signal of a second viewable display resolution, pixel rate, vi(Jeo ^ ^ order , o acbieve , he format 

and Une rate. Also, by operating the display timing generator at a different 

2. Description of the Related Art frame rate than the video input source frame rate, a conver- 
There are numerous kinds of interlaced video signals such s ion of frame rates is achieved. Conventionally, such display 

as NTSC and PAL, as well as progressive scan video signals timing generators are either synchronized on a frame by 

such as computer video output VESA VGA, SVGA, XGA, frame basis to maintain frame lock with the input video 

and SXGA. These and other sources typically have different source, or are allowed to free run relative to the input video 

resolutions in terms of pixels per line, lines per frame, as frame rate. 

well as different video timing in terms of horizontal line rate when the display timing generator is free running then the 

and vertical refresh rate. In order to accommodate many 2Q rate at wn ich video input lines are required to be processed 

different types of input video signals for viewing on a single mt0 display output lines may not match the display output 

display device several methodologies have been adopted in i ine rat6) and me difference between the actual input rate and 

the prior art. the required input rate to sustain the processed display rate 

A first prior art method involves adapting the operating must be accommodated through memory buffering. Also, if 

format of the display device to match the resolution and 25 the input and output frame or field rates do not match, then 

video timing of the source input video. According to this input frames or fields are either repeated or dropped by the 

method, the display device must be capable of adapting to frame buffer controller. This results in temporal artifacts for 

different resolutions and video timings of the available input high motion sequences because of repeated or dropped input 

video sources. Therefore, this prior art methodology is frames or fields being used as source data for processing into 

commonly practiced with Cathode Ray Tube (CRT) devices 30 display frames. Also, when only a single frame of memory 

which display video image data by modulating an electron is provided in the memory buffer and the display frame rate 

beam intensity while sweeping the beam both horizontally is not locked with the input video frame or field rate then the 

and vertically across a phosphor coated viewing surface. The input video data write pointer can cross paths with the 

CRT can adapt to different input formats by detecting the display processing data read pointer creating the situation 

input video source horizontal line and vertical frame rate and 35 where a display frame may be comprised of image data 

then automatically phase locking and adjusting the CRT processed from two different input frames captured at dif- 

display horizontal and vertical sweep rates to the detected ferent points in time. This produces an objectionable artifact, 

input rates in order to maximize the active portion displayed usually referred to as "frame tear", in the display output 

on the viewing surface. when the source video contains high motion sequences as 

This first prior art method is not commonly used for 40 media content. Thus, if the display device can lock the 

displays wherein the viewable display region is made up of display frame or field rate to the input video frame or field 

discrete image elements (pixels) arranged in a two dimen- rate there are significant advantages because fields or frames 

sional matrix and wherein no horizontal and vertical beam no longer need to be repeated or discarded and temporal 

sweep apparatus is provided which can be adjusted to distortions in the display video sequence can be eliminated, 

accommodate different input formats. One class of such 45 In the majority of pixel based displays, such as FPD 

discrete pixel displays is referred to as Flat Panel Displays devices, the individual pixel elements are selected or 

(FPDs) which includes Liquid Crystal Displays (LCDs), enabled through the use of an orthogonal scanned interface 

Field Emissive Displays (FEDs), Plasma Display Panels where pixel columns are selected based on a number of 

(PDPs), as well as many other emerging technologies. timing clock cycles relative to a horizontal sync signal or 

A second prior art method of accommodating different 50 data enable signal, and a particular row of pixels is selected 

types of input video signals for viewing on a single display based on the number of horizontal sync or data enable pulses 

device involves converting the source resolution and timing that have occurred relative to a vertical sync position. This 

to a format that is supported by the display device. This prior column and row selection process enables a pixel or group 

art method converts the input source video format by means of pixels to be refreshed. 

of pixel conversion, line conversion, and frame frequency 55 In the case of format conversion, it has become common 

conversion to a target video format that is supported by the practice to frame lock a display timing generator with an 

target display device. Conventional format conversion cir- input video source by allowing the display timing generator 

cuits operate by taking a digital video signal, extracting the to free run from the start of the display vertical sync pulse, 

desired viewable or active portion of the video fields or through the entire active region, to the vertical blanking 

frames, and storing the active portion into a frame buffer. 60 front porch region. At this point, the display timing genera - 

The frame buffer provides elasticity so that the data write tor continues to scan blank lines until the input video vertical 

rate need not match the display read rate. The stored data is sync pulse causes the display timing generator to immedi- 

then read from the display frame buffer and processed to ately jump to the start of the display vertical sync pulse, 

convert the number of pixels per image line, and the number Then, the display timing generator returns to free run 

of lines per image, to match those of the display device. 65 operation. Many pixel based displays can accommodate this 

Such processing typically incurs latency between the time step change to the display timing sequence since the indi- 

when source video data is available at the video source, and vidual pixel or groups of pixel elements are addressable in 
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a sequential fashion relative to the synchronization pulses. 
Once the entire active region has been updated, the step 
change to timing in the vertical blanking front porch region, 
prior to the vertical synchronization pulse, does not visually 
affect the display. It is relatively easy to implement a 5 
"vertical reset'* feature in a display timing generator. The 
other advantage to this technique is that the display timing 
generator can use a free running display pixel clock which 
need not be synchronized to the input video pixel clock, line 
rate, or frame rate. 10 

However, a principal disadvantage of this technique is 
that since the display line rate is based on a free running 
pixel clock, there can be no exact relationship between the 
input line rate and the rate at which the input lines need to 
be processed to sustain the display output rate. Therefore, 15 
this implementation requires that enough memory be pro- 
vided so that input video lines of data are available to sustain 
the display processing rate for the worst case difference 
between the input video line rate and the display output 
processing line rate. Thus, in many format conversion sys- 20 
terns a full frame buffer or more of memory is provided. 
Another significant disadvantage is that this type of frame 
locking can not be used to drive a CRT type of display 
device since in many cases the step change to the display 
timing is of sufficient magnitude to cause the horizontal and 25 
vertical sweep phase lock loops of the CRT controller to lose 
lock and the resulting transient during lock acquisition 
causes noticeable artifacts on the resulting displayed video 
images. 

Also, for applications requiring arbitrary image zoom or 30 
shrink processing of the active pixel data as part of the 
format conversion capability, large amounts of memory are 
required. Therefore, most arbitrary zoom or shrink systems 
are implemented with a full frame of memory or more. 

For the standard application of converting input formats 
to a different output format where both formats have the 
same aspect ratio, the required image zoom or shrink is not 
entirely arbitrary and the ratio of active pixels to total pixels, 
and active lines to total lines, tends to remain constant for 4Q 
most input formats of the same aspect ratio. In this situation, 
using a free running display timing generator requires more 
memory than other possible implementations, even if it has 
vertical reset for frame synchronization. 

One example of a display processor implementation is 45 
described in U.S. Pat. No. 5,600,347 in which a method is 
set forth for nonlinear horizontal expansion. However, this 
prior art patent does not deal with the synchronization issues 
discussed above relating to performing format conversion 
with a minimum amount of memory buffer. 50 

Many discrete pixel displays such as FPD devices have 
undergone technological improvements that enable them to 
now support a range of frame refresh rates so that frame rate 
conversion may not be required in the future. Nonetheless, 
due to the discrete pixel nature of these devices there is still 55 
a requirement for apparatus to adapt the input source video 
pixel rate, line rate, and display able format to match the 
fixed active pixel arrangement of the display device. 

Therefore, a display timing generator implementation 
which supports free running modes in applications where a 60 
frame buffer is used for arbitrary zoom, shrink, or other 
image processing, is highly desirable. Preferably, such a 
display timing generator should also provide a frame lock 
implementation that minimizes the above-discussed step 
change to the display timing sequence, so that both discrete 65 
pixel display devices as well as CRT devices can be sup- 
ported. The novel apparatus should implement a display 
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timing generation technique that minimizes the memory 
buffer needed to support non -arbitrary zoom, shrink, or 
image processing operations for format conversions. As 
indicated above, such a display timing generator is highly 
desirable since it would reduce the costs of video processing 
systems and provide a common apparatus that could be 
utilized in many types of devices for converting images from 
a first input format to a second display format. 

The following patents provide descriptions of the various 
prior art systems discussed above: 

U.S. Pat. No. 4,275,421 entitled LCD CONTROLLER; 
U.S. Pal. No. 4,872,054 entitled VIDEO INTERFACE 
FOR CAPTURING AN INCOMING SIGNAL AND 
REFORMATTING THE VIDEO SIGNAL; 
U.S. Pat. No. 5,351,088 entitled IMAGE DISPLAY 
APPARATUS FOR DISPLAYING IMAGES OF A 
PLURALITY OF KINDS OF VIDEO SIGNALS 
WITH ASYNCHRONOUS SYNCHRONIZING SIG- 
NALS AND A TIMING CORRECTION CIRCUIT; 
U.S. Pat. No. 5,446,496 entitled FRAME RATE CON- 
VERSION WITH ASYNCHRONOUS PIXEL 
CLOCKS; 

U.S. Pat. No. 5,508,714 entitled DISPLAY CONTROL 
APPARATUS FOR CONVERTING CRT RESOLU- 
TION INTO PDP RESOLUTION BY HARDWARE; 

U.S. Pat. No. 5,517,253 entitled MULTI-SOURCE 
VIDEO SYNCHRONIZATION; 

U.S. Pat. No. 5,534,883 entitled VIDEO SIGNAL 
INTERFACE; 

U.S. Pat. No. 5,561,472 entitled VIDEO CONVERTER 
HAVING RELOCATABLE AND RESIZABLE WIN- 
DOWS; 

U.S. Pat. No. 5,579,025 entitled DISPLAY CONTROL 
DEVICE FOR CONTROLLING FIRST AND SEC- 
OND DISPLAYS OF DIFFERENT TYPES; 

U.S. Pat. No. 5,600,347 entitled HORIZONTAL IMAGE 
EXPANSION SYSTEM FOR FLAT PANEL DIS- 
PLAYS; and 

U.S. Pat. No. 5,585,856 entitled IMAGE PROCESSING 
APPARATUS THAT CAN PROVIDE IMAGE DATA 
OF HIGH QUALITY WITHOUT DETERIORATION 
IN PICTURE QUALITY. 

SUMMARY OF THE INVENTION 

A general object of an aspect of the present invention is 
to provide a method and apparatus for producing video 
signal timing for a display device that has a display format 
different from the input video format. 

It is also an object of an aspect of the invention to provide 
a method and apparatus for producing video signal timing in 
cases where the input video line rate and display output line 
rates are not the same. It is also an object of an aspect of this 
invention to provide a method and apparatus for synchro- 
nizing the display output line rate to the input line rate so that 
the source video line input rate can sustain the rate at which 
the input lines are processed to generate display video lines 
using a minimum amount of memory buffer for a variety of 
display processing methods. 

It is also an object of an aspect of the invention to provide 
a method and apparatus for synchronizing display output 
timing to input video timing such that both are locked in 
terms of frame rate, but skewed in terms of frame phase, in 
order to accommodate latency incurred by processing of 
source video data to generate the display video data. It is a 
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further object of an aspect of the invention to provide a display device such as an FPD. If the display output device 

method and apparatus for adjusting the skew between the is capable of supporting a display frame rate that matches the 

input source video frame timing and the display output video input PAL field rate then the amount of memory buffer 

frame timing to accommodate latency for various types of required can be reduced to much less than that required to 

display processing such as, but not limited to, scaling, video 5 store a full field of PAL active data, 

format conversion, and filtering operations. In the case of a digitized VGA input source signal then the 

In order to achieve the aforementioned objectives, accord- incoming frames of VGA data can be processed into a 

ing to the present invention there is provided a format different format and used to drive VGA timing compatible 

converter for receiving a digital video input signal charac- displays, SVGA timing compatible displays, or XGA timing 

terized by a first viewable display resolution, pixel rate and io compatible displays. The display device can be either a CRT 

line rate, and in response generating a digital video output display device or a discrete pixel display device such as an 

signal for viewing on a display characterized by a second FPD. If the display output device is capable of supporting a 

viewable display resolution, pixel rate and line rate, said display frame rate that matches the input VGA frame rate 

format converter comprising: men me amount of memory buffer required can be reduced 

programming interface means for receiving operating 15 to much less than that required to store a full VGA frame of 

mode information indicative of said first and second active data. 

viewable display resolutions, pixel rates and line rates; Furthermore, according to the present invention many 
r , . -j j- i *j • * ■ i other digitized or digital video signals (interlaced or pro- 
memory means for storing said digital video input signal; . & x , b , .° . * _ , j 
3 & & r © gressive scan) can be processed into different formats and 
display processor means for retrieving said digital video 2Q ^ tQ driye display devices whh different formats in terms 

input signal from said memory means, selectively of pixels pef Une and Unes per fram£ 

de-interlacing, filtering and scaling said digital V1 deo according t0 the present inve ntion if the input digital 

input signal, and in response generating said digital yideo signal is [Q be converted lo a different display frame 

video output signal; and ratCj then display timing can be produce d at a display frame 

display timing controller means for deriving synchrom- 25 rate thal is nol rdated t0 the input frame rate However, in 

zation and control information from said digital video this case lhe mem0 ry buffer will require at least one input 

input signal based on said operating mode information field or frame of mem0I y 

received by said programming interface means, and in y n addition, according to the present invention the display 
response controlling operation of said display proces- outpul ^ rate can be a ratio multiple of the input pixel rate 
sor means to generate said digital video output signal 30 to minimize the amount of memory required for processing 
for display at said second viewable display resolution, 0 f input data to generate display outpul data. The display line 
pixel rate and line rate. period according to the invention varies in period by a +/- 
According to a further aspect of the present invention, the pixel periods on a line by line basis. Many FPD devices can 
display timing controller further comprises: accommodate this degree of line jitter. The method of line 
clock generation means for generating a display main 35 rate generation according to this aspect of the invention does 
clock signal; not require a display pixel clock phase locked loop, 
a lock event controller for generating a lock event signal Therefore, a free running oscillator can be used to generate 
at a predetermined instant of each frame of said digital the display timing thereby reducing system cost and corn- 
video input signal; display synchronizer means for plexity. Also, since the display line rate is synchronized to 
generating a display horizontal lock event signal and a 40 the input video line rate then a minimum of memory buffer 
display vertical lock event signal for controlling syn- is needed which can further reduce the system cost, 
chronization between said digital video input signal and 
said digital video output signal based on said lock event 
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signal and said operating mode information; and A detailed description of the preferred embodiment is 

display timing generator means for generating timing 45 provided herein below with reference to the following 

signals synchronized to said horizontal and vertical drawings, in which: 

lock event signals to control said display processor FIG. 1 is a block diagram of a multi-sync type discrete 

means in accordance with said operating mode infor- pixel display device with format conversion according to the 

mation. present invention; 

Thus, according to the present invention, in the case of a 50 FIG. 2 is a block diagram of a multi-sync CRT device with 

digitized and decoded NTSC input source signal the incom- format conversion according to the present invention; 

ing fields of NTSC data can be processed into a progressive HG 3 is a Mock diagram of a formal accor ding 

scan format and used to drive VGA timing compatible tQ the eQt invention; 

displays SVGA timing compatible displays, or XGA timmg Fia 4 ^ a block di of a display timing of 

compatible displays^ display device can be either a CRT 55 ^ fm & * {Q ^ ^ embodimenl; 

d^play device or a discrete pixel display device such as an acco 
FPD. If the display output device is capable of supporting a 

display frame rate that matches the input NTSC field rate to the preferred embodiment; 

then the amount of memory buffer required can be reduced FIG *. 6 * a bloc * dia S ran ? ° f a lock cvent generator 

to much less than that required to store a full NTSC field of 60 according to the preferred embodiment; 

active data, FIG - 7 ^ a block diagram of a display clock generator 

In the case of a digitized and decoded PAL input source according to the preferred embodiment; 

signal the incoming fields of PAL data can be processed into FIG. 8 is a block diagram of a display synchronizer 

a progressive scan format and used to drive VESA VGA according to the preferred embodiment; 

timing compatible displays, SVGA timing compatible 65 FIG. 9 is a block diagram of a display timing generator 

displays, or XGA timing compatible displays. The display horizontal controller according to the preferred embodi- 

device can be either a CRT display device or a discrete pixel ment; 
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FIG. 10 is a block diagram of a display timing generator 
vertical controller according to the preferred embodiment; 

FIG. 11 is a timing chart which shows free run mode 
display timing startup according to the present invention; 

FIG. 12 is a timing chart which shows free run mode 5 
display timing during an input lock event according to the 
present invention; 

FIG. 13 is a timing chart which shows display timing 
generation start up for frame locked mode or for line jq 
synchronized mode according to the present invention; 

FIG. 14 is a timing chart which shows lock event timing 
for frame lock mode or line synchronized mode according to 
the present invention; and 

FIG. 15 is a timing chart which shows display end of line 15 
timing for line synchronized mode according to the present 
invention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

20 

FIG. 1 is a block diagram showing the construction of a 
multi-sync type discrete pixel display device. The input 
selector 100 and format converter 110 of this diagram 
implement the format conversion feature according to the 
present invention. The video decoder 120 and video input 25 
interface 130 are well known devices, as is the microcon- 
troller 150 and the actual flat panel display device 140. The 
format converter 110 has an external input frame synchro- 
nizing signal (FSYNC) which can be used to control display 
timing frame rate. 30 

FIG. 2 shows an embodiment of the invention applicable 
to a multi-sync CRT device. The input selector 100, format 
converter 110, video decoder 120, video input interface 130, 
and microcontroller 150 function in the same manner as the 
embodiment of FIG. 1. However, in this embodiment a 35 
digital to analog converter 155 is connected between the 
output of format converter 110 and a CRT display 160, in a 
well known manner. As will be apparent from the following 
description, the input selector 100 and format converter 110 
according to the present invention are capable of controlling 40 
either a flat panel display such as display 140 in FIG. 1 or 
a CRT display such as display 160 in FIG. 2. 

MICROCONTROLLER DESCRIPTION 

The micro controller 150 shown in FIGS. 1 and 2 is used 45 
to program control registers within the display device com- 
ponents to determine the operating mode and operating 
parameters for selecting and converting the video source to 
the desired display output format for display on the targeted 
display device. 50 

The micro controller 150 transfers operating parameters 
to the control registers in the various components and reads 
back any status information from those components by 
means of a programming interface (PROGIF) which is a 
conventional micro controller communication bus that can 55 
be implemented using a variety methods such as I 2 C, a 
microprocessor parallel address/data bus with chip selects, 
or serial peripheral interface (SPI). The embodiment pre- 
sented herein uses a serial communication bus implemen- 
tation as the micro controller programming interface 60 
(PROGIF) for communicating with the input selector 100 
and format converter 110 and their respective programmable 
sub-components. 

INPUT SELECTOR DESCRIPTION 65 

The input selector 100 shown in FIGS. 1 and 2 provides 
the capability to selectively accept as input a digital video 
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signal from two video sources, video decoder 120 or video 
input interface 130, each of which is connected to a respec- 
tive video input port. Each of the digital video input signals 
comprises of a pixel clock (CLK1 and CLK2, respectively), 
a pixel clock enable (CLKEN1 and CLKEN2, respectively), 
a horizontal synchronizing signal (HSYNC1 and HSYNC2, 
respectively), a vertical synchronizing signal (VSYNC1 and 
VSYNC2, respectively), a shared odd field status flag 
(ODD) and a data bus signal (DATA1 and DATA2, 
respectively). 

The first input port (referred to herein as Port #1) of input 
selector 100 is connected to video decoder 120 and accepts 
either 4:4:4 sampled RGB data or 4:2:2 sampled YUV data. 
The second input port (referred to herein as Port #2) of input 
selector 100 is connected to video input interface 130 and 
accepts 4:4:4 sampled RGB data. Either input port can 
accept as input both interlaced and progressive scanned 
input video signals. A single ODD field status flag is shared 
by the two ports and must be driven by the active input port 
(Port #1 or Port #2) when an interlaced scanned input video 
signal is used as input. 

FIG. 1 and FIG. 2 show a video input interface 130 that 
provides progressively scanned input video on Port #2, so in 
this implementation the video input interface does not drive 
the ODD field status signal (ODD). However the input 
selector 100 can accept interlaced input video at Port #2 
under control of the shared ODD field status. 

Turning to FIG. 5, the structure of input selector 100 is 
shown in greater detail. The input selector 100 processes 
4:2:2 YUV (DATA1) data using a digital interpolator 505 to 
up sample the data stream in order to generate intermediate 
4:4:4 YUV dala. The 4:4:4 YUV data is then color space 
converted using a 3x3 multiplier matrix with fixed coeffi- 
cients 510 to generate a 4:4:4 RGB data stream (RGB' 
4:4:4') that is visually equivalent to the YUV data when 
displayed. The clock enable and synchronizing signals 
applied to Port #1 of input selector 100 are delayed through 
pipe lined storage elements 520, 535, 545, 555 to be latency 
aligned with the CSC processing delay of the color space 
converted 4:4:4 RGB data stream. 

The Port #2 4:4:4 RGB data and control signals, the Port 
#1 4:4:4 RGB data and control signals, and the Port #1 color 
space converted RGB' 4:4:4' data and CSC processing 
delayed control signals are input to selectors 515, 525, 530, 
540, 550, and 560 which pass one of the Port #1 or Port #2 
digital video signals to the appropriate outputs IPDATA, 
IPODD, IPCLK, IPCLKEN, IPVSYNC and IPHSYNC. The 
IPDATA output is always in RGB 4:4:4 data format. The 
selectors 515, 525, 530, 540, 550 and 560 and controlled by 
a programmable control register 500 which is programmed 
by means of the micro controller programming interface 
(PROGIF) to select either Port #1 or Port #2 for input, and 
also to select either YUV 4:4:4 input data or RGB 4:4:4 
input data operation when Port #1 is selected, and to 
additionally select either interlaced or progressive scan input 
operation. 

When progressive scan input video is selected then the 
input ODD signal is ignored and the output IPODD signal is 
always driven active. When interlaced input video is 
selected then the input ODD signal indicates which field, 
ODD or EVEN, is being input and the output IPODD signal 
corresponds to the ODD input signal. 

As will be appreciated from the foregoing, the function- 
ality of the input selector 100 is implemented entirely by 
circuits and circuit configurations that are conventional in 
practice with the only exception being the configuration of 
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two separate ports (i.e. Port #1 which accepts both YUV or is programmable using the micro controller programming 

RGB input and Port #2 which is dedicated to RGB input interface port (PROGIF) to determine the start line location 

signals), and both ports accepting either interlaced or pro- and duration of the vertical active region in terms of input 

gressive scan inputs. lines. Two start line locations are, supported, one for odd 

5 fields and one for even fields. The memory write controller 

FORMAT CONVERTER DESCRIPTION can be programmed to select either interlaced input or 

™ c . _ nn .j • . . t progressive scan input video operation by means of the 

rhe format converter 110 provides the capability to accept K„;L-irr - ■? • / j i .u 

f- i. L .i_ r.' ui PROGIF port. For progressive scan input video only the 

as input a digital video input signal that has a first viewable r , .. V & . . . r ... 

j. , i * | 1 1 • t j . programmed active line start location corresponding with 

display resolution, pixel rate, and line rate, and produces as rt JLJl c . j r* * • * i j . *u T nomr\ 
5 , ,r . . . ' . i ,i it_ j * £r .10 ODD fields is used. Dunne interlaced scan input the IPODD 

output a second digital video signal that has a different . . . . L - L r. L j i* 

j . i . . ? . t ji- * a i_ ■ signal determines which of the programmed active line start 

display resolution, pixel rate, and line rate. As shown in FIG. /^Ut^ ™/t^t\ • j . j . • .i_ * i- r.L 

- f, J f *.r (ODD or EVEN) is used to determine the starting line of the 

3, the format converter 110 consists of a memory write > n video active re ion 

controller 300, memory 310, a display processor 320, and a in ^ u V1 eo ac lve re S l0n - 

display timing controller 330. The format converter 110 n * memory write controller 300 also counts the number 

achieves the conversion from the input format to the display 15 of IPCLK c V cles relative t0 the IPHSYNC pulse to deter- 

output format by processing input lines of pixel data using mme lhe in P ut Vlde0 horizontal active region in terms of 

a de-interlacing, filtering, and scaling algorithm set forth in IPCLK c y cles - 0nlv IPCLK c V des durin S which IPCLKEN 

greater detail below, to generate the desired display output 15 actlve are counted. Cycles during which IPCLKEN is not 

format active are ignored. The memory write controller is program - 

20 mable using the micro controller programming interface 

MEMORY DESCRIPTION (PROGIF) to determine the start and duration of the video 

horizontal active region in terms of IPCLK cycles. 

A memory 310 is provided in lhe format converter data ^ active ion is defifled M the Jon fa the videQ 

path in order to accommodate a video input clock (IPCLK) ta fle , dor frame wbefe ^ horizontal and vertical activc 

^? a ^ be ™nn>"8 to lne d *P la y output clock 25 fons Me tfue Durj the active jon , ime intervak , he 

(DCLK). Also, the memory 310 provides elasticity to m wrfte samples the data mputs during 

accommodate differences between the video input line rate jp CLK les ff IPCL KEN is active to acquire active data, 

and the rate at which input lines are consumed by the display ^ |ed . ac , jve data js p{odua . d at the memory 

processing circuitry of the present invention . for generating wri , e controller WRITE_DATAoutput in order to be written 

the display output. Memory 310 also provides means for 30 mtQ ^ memorv 3^9 

restructuring the input video frame or field scanning so as to _ " „ . _ A , , . , 
support predetermined display processing input data . The memory wnte controller 300 also produces address- 
requirements. For example, vertical linear interpolation mg information memory bank select signals and a write 
requires two adjacent input lines to be available for the enable signal (collectively designated asWRCNTRLm HG. 
bi-linear interpolator to generate each display output line, as 35 3 J to enab,e wn , tin S ° f m P ut data into the memory 310 
discussed in greater detail below. durm 6 . those ^les where the memory write controller is 
_ --a t ., • i producing valid active data on the WRITE_DATA signal 
The memory 310 can be easily implemented using con- out ts as contr olled by the IPCLKEN signal and decoded 

"o tl0 " al F1 c F o°\? RA ^' ^> SDRA ^ ™*AM> active region. According to the preferred embodiment, 

GRAM, or SRAM technology According to the preferred sim fc ^ b[ coumers te lhe addressi infor . 

embodiment, an array of SRAM is used such that individual 40 ^ ^ Qn g dock b dock basis by the 

SRAM memory banks can be allocated for wnte operations { dock enabk gi , (IPCLKEN) t0 allow stalling orJ a 

which occur synchronously to the inputpixel clock under ixd b ixd basis {Q . ^ streams where 

control of wnte control signals (WRCNTRL). Meanwhile, eacfa dock iod (IpCLK) nQt necessaril contain 

other mdividual SRAM memory banks can be al ocated for yalid . data ^ illuslrated ernbodirnenl a iso cont ains a 

read operations synchronous to the ^display clock (DCLK) 45 fc ^ whicfa oduces a wd(e enable 

and display read control signals (RDCNTRL) generated by ^ tQ COQtrol ^ of dala tQ ^ m no [n Qrder 

the display processor 320. The various ones of the memory to maintain synchronization with the write address and bank 

banks can be indmduaUy aUocated for write or read opera- select &{ ls (WRCNTRL) and active output data 

tions synchronous to the respective input video clock (WR1TE_DATA). The stale controller also generates 

(IPCLK) or the display clock (DCLK). 50 ^ which Miy[dml memory 

banks for write operations sequentially in a circular buffer 
sequence. An input active pulse on IPVSYNC initializes the 
state controller to the empty state such that the first bank of 

The purpose of the memory write controller 300 is to store 55 the memory is selected for writing the first video line of 

incoming video data into the memory as a series of video input data at the start of each input field or frame, 
lines that can then be addressed and read by the display 

processor 320. DISPLAY PROCESSOR DESCRIPTION 

The memory write controller 300 accepts as input the The display processor 320 provides means for generating 

digital video data (IPDATA), clock (IPCLK), clock enable 60 address and control signals (RDCNTRL) to control the 

(IPCLKEN), field status (IPODD) and synchronization con- reading of data from the memory 310. The data produced 

trol signals (IPHSYNC and IPVSYNC) from the input during memory 310 read operations (READ__DATA) is 

selector 100 (FIG. 5). utilized by the display processor 320 which implements an 

The memory write controller 300 counts the number of image de-interlacing, filtering, and scaling algorithm to 

IPHSYNC pulses relative to the IPVSYNC pulse to deter- 65 produce the display output data (DDATA). 

mine the start and duration of the input video vertical active The display processor is programmable by means of the 

region in terms of input lines. The memory write controller micro controller programming interface (PROGIF) to enable 



MEMORY WRITE CONTROLLER 
DESCRIPTION 
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or disable the de-interlacing function and to adjust the 
scaling and filtering function to produce the desired output 
image resolution from image data read from the memory 
310. 

When de-interlacing is enabled the IPODD input signal 5 
determines how the input data fields (READ_DATA) are 
processed in terms of the vertical offset between interlaced 
video fields. When de-interlacing is disabled then the 
IPODD input signal is ignored and image data read from 
memory is processed as frames. 10 

The display processor 320 is initialized to begin process- 
ing a new display frame whenever the display timing 
controller 330 initiates a new display frame by means of the 
display vertical sync pulse (DVSYNC). The display proces- 
sor then requests the first lines of image data from the 15 
memory 310 by supplying address, bank selects and acti- 
vating the read enable signal to the memory (collectively as 
RDCNTRL). The memory responds with the image data 
(READ_DATA) and a data valid signal (READ__VALID) 
whenever the requested data is available. The display pro- 20 
cessor can be stalled by the data valid signal (READ_ 
VALID) as required by the memory. The display processor 
pre-fills the entire display processing data path up until the 
output stage which drives DDAXA. Once the display pro- 
cessing data path has pre-filled it is then also controlled on 25 
a clock by clock basis by the display timing controller 330 
data enable (DEN) signal to ensure that the display output 
data is aligned with the active region. The memory provides 
data (READ„DATA) at a sufficient rate to support display 
processing to generate contiguous horizontal active regions 30 
of display data at the display outputs (DDATA). The display 
timing generator is programmed by means of the micro 
controller programming interface (PROGIF) to set the 
latency between the input video frame or field timing start of 
active region relative to the display output timing start of 35 
active region such that it matches the latency through the 
memory write controller 300, memory 310, and display 
processor 320 in order to prevent overflowing or under 
flowing the memory during the format conversion process. 

DISPLAY TIMING CONTROLLER 
DESCRIPTION 

The display timing controller 330 of FIG. 3 is shown in 
greater detail in FIG. 4 comprising a lock event generator 45 
400 for determining a synchronizing event (LOCKEVENT) 
from the input video frame timing to which the display 
timing is to be locked, a display synchronizer 410 for 
generating synchronizing signals (DHLOCKEVENT and 
DVLOCKEVENT) for controlling the phase relationship 50 
between the display frame phase relative to the input lock 
event (LOCKEVENT) and in one mode (Line Synchronized 
Mode) also for controlling the display line rate as a function 
of the input master clock (IPCLK), a display clock generator 
420 for producing the display master clock (DCLK) as a 55 
function of either an internally generated free running clock 
or the input video master clock (IPCLK), and a display 
timing generator 430 for generating display video timing 
based upon the display master clock (DCLK) and the 
synchronizing signals generated by the display synchronizer 60 
410. 

DISPLAY CLOCK GENERATOR DESCRIPTION 

The display clock generator 420 is shown in greater detail 
with reference to FIG. 7, consisting of a free running 65 
oscillator source 710, an ICD2061 frequency synthesis 
phase lock loop 740, a second frequency synthesis phase 



,922 Bl 

12 

lock loop 730 implemented using a IS CI 522, and a clock 
selector 750 controlled by a programmable control register 
720 to select either the free running clock or a ratio multiple 
of the input clock to be output by the display clock generator 
420 as the display main clock (DCLK). 

The free running oscillator source 710 produces a free 
running clock (REFCLK) that is not synchronized to the 
input video signal. This oscillator is implemented using a 
conventional oscillator implementation which provides the 
reference clock to the ICK2061 740 which multiples the 
reference clock by a ratio multiple to produce a first avail- 
able display clock (FREEUNCLK) which is free running 
relative to the input video source. This free running display 
clock source is used when operating the display synchro- 
nizer 410 in line sync or free run modes when the display 
output frame timing does not need to be synchronized to the 
input frame timing by means of IPCLK to DCLK synchro- 
nization. The ICD2061 740, is programmable by means of 
the micro controller programming interface (PROGIF) for 
determining the ratio multiple. 

The second frequency synthesis phase lock loop is imple- 
mented using an ICS 15 22 730, which multiples the video 
input main clock by a frequency synthesis ratio to produce 
a second display available display clock which is synchro- 
nized to the input video source. The ICS1522 is program- 
mable by means of the micro controller programming inter- 
face (PROGIF) to control the multiply ratio for producing 
the desired DCLK from the IPCLK. This synchronized 
display clock source is used when operating the display 
synchronizer in frame lock mode, to synchronize the display 
output line timing with the input line timing in order to 
minimize the amount of memory 310 and to minimize any 
transients to the display timing during frame locking cor- 
rections to the display timing. 

The clock selector selects either the first display clock 
source or the second display clock source to drive the DCLK 
output to the display synchronizer 410, display timing 
generator 430, memory 310, display processor 320, and the 
format converter 110 display output interface. The selection 
is controlled by means of a programmable control register 
720 which is programmed by means of the micro controller 
programing interface (PROGIF). 

The resulting display clock (DCLK) controls the clock 
rate at which memory read operations and display process- 
ing operations are performed, the rate at which the display 
timing generator synchronization signals are generated, as 
well as the rate at which display data and control information 
is transferred from the format converter 110 to the display 
device. 

LOCK EVENT GENERATOR DESCRIPTION 

The lock event generator 400 is shown in greater detail 
with reference to FIG. 6 comprising a horizontal pixel event 
counter 610, a horizontal pixel event comparator 620, a 
vertical line event counter 640, a vertical line event com- 
parator 650, a programmable control register 630 for select- 
ing the location in the input frame timing where the hori- 
zontal and vertical events are to occur, a lock event generator 
circuit 660, and a lock event selector 670. 

The horizontal pixel event counter 610 counts the number 
pixel clock cycles (IPCLK) relative to when an input hori- 
zontal synchronization pulse (IPHSYNC) is detected. Only 
pixel clock cycles during which IPCLKEN is active are 
counted. Pixel clocks where IPCLKEN is not active are not 
counted. The horizontal pixel count is compared in com- 
parator 620 with a programmable horizontal lock event 
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value (IPHLOCKVAL). When the horizontal pixel count is 815, an adder carry output register 820, a display vertical 

equal to the programmable horizontal lock event value, then lock load gate 830, a display timing generator run enable 

a horizontal lock event pulse (IPHLOCKEVENT) is pro- gate 835, a display horizontal lock load selector 840, a 

duced by the comparator 620. The horizontal lock event display horizontal lock load re -synchronizer 855, a display 

pulse indicates that the input digital video timing is at a 5 vertical lock load selector 845, a display vertical lock load 

predetermined point of an input line. re-synchronizer 860, a display timing generator run selector 

The vertical line counter 640 counts the number of input 850, and a display timing generator run re-synchronizer 865. 

horizontal synchronization pulses (IPHSYNC) relative to The programmable control register 805 is programmable 

when an input vertical synchronization pulse (IPVSYNC) is by means of the micro controller programming interface 

detected. Thus, the vertical line counter counts video input 10 (PROGIF). The programmable control register determines 

lines. The vertical line count is compared in comparator 650 the state of the display timing generator enable (DTGRUN_ 

with a programmable vertical lock event value CTRL), the display line rate control value (INCREMENT), 

(IPLOCKVAL). When the vertical line count and the pro- and the mode selection (MODECTRL). 

grammable vertical lock event value are equal and the The display synchronizer 410 produces three output sig- 

IPODD input signal is active, then the comparator 650 is na i s; display horizontal lock event (DHLOCKEVENT), 

produces active pulse on the vertical synchronization signal display vertical lock event (DVLOCKEVENT) and display 

output (IPVLOCKEVENT). The vertical lock event pulse timing generator run (DTGRUN). The display horizontal 

indicates that the input digital video timing is at a predeter- and vertical lock event signals are used to force synchroni- 

mined line of an input frame. The IPODD signal ensures that za tion of the display timing generator 430 with the video 

only one vertical lock event (IPVLOCKEVENT) pulse 20 input signal accor ding to the selected operating mode of the 

occurs for every input frame. display synchronizer 410. The DTGRUN control signal is 

The programmable control register 630 has as an input used for start-up synchronization of the display timing 

field select signal (IPODD). The IPODD signal indicates generator and a disable for halting the display timing gen- 

which input field is active for input digital video sources erator. 

where the lines are scanned using an interlaced video format. 25 The timing synchronizer 410 supports four fundamental 

For input digital video sources where the lines are scanned operating modes and is programmable to select one of these 

using a progressive scan format, then the ODD signal is held modes which determines the method for synchronizing the 

in the active state by the driving source, the source being the display timing generator 430 with the input video source, 

input selector 100. The operating modes supported are as follows: Free run 

Whenever the vertical lock event (IPVLOCKEVENT) Mode, Clock Synchronized Mode, Frame Synchronized 

and horizontal lock event (IPHLOCKEVENT) pulses coin- Mode and Line Synchronized Mode, 
cide the lock event generator 660 produces an active pulse 

on the signal HVLOCKEVENT. FREE RUN MODE DESCRIPTION 

The lock event selector 670 selects either the HVLOCK- 35 The display synchronizer 410 operates in FREE RUN 

EVENT signal or the FSYNC signal as the source of the MODE according to the MODECTRL signal. FREE RUN 

output LOCKEVENT signal according to the DFSYNCEN MODE provides the ability to allow the display timing to be 

select control signal. DFSYNCEN is generated by the pro- generated independently of any input video source with the 

grammable control register 630 according to a control timing based on a free running clock source and no syn- 

register word provided by means of the micro controller 4Q chronization as supplied by the display synchronizer 410. 

programming interface (PROGIF). This provides the addi- This mode is for use in format converter systems where a 

tional capability for controlling the synchronization of the frame buffer is used to de-couple the display frame rate from 

display output timing directly by the DFSYNC external the input video rate by means of a frame buffer situated 

input signal. between the input video source and the input selector 100 of 

The lock event is a single pulse which occurs once per 45 the format converter. The frame buffer would in this case 

video input frame which can then be used to synchronize the supply video data and synchronization signals to the input 

display output frame rate to the input frame rate. selector 100 at a rate that is synchronized to the display 

Since interlaced formats use a Vi line offset between the output frame rate, 

input odd or even fields, in order to achieve interleaving of When FREE RUN MODE is active, then the DTGRUN 

the active lines to produce complete frames, then an obvious 50 SELECT 850 directly controls the state of IDTGRUN as a 

adaptation of the above-described lock event controller is to function of DTGRUN_CTRL, The IDTGRUN signal is 

add the ability to generate a lock event once per field during then re-synchronized from the input clock domain (IPCLK) 

interlaced video input. To do this every other field would to the display clock domain (DCLK) by means of DTGRUN 

have the lock event delayed by V£ of an input line period in RESYNC 865 to generate an output DTGRUN signal that is 

order to maintain a constant period between lock events. 55 synchronous to the display clock (DCLK) for the purpose of 



DISPLAY SYNCHRONIZER DESCRIPTION 



enabling or disabling the display timer generator 430. 
The DTG_RUN output signal is produced from the 
The display synchronizer 410 is shown in greater detail DTGRUN_CTKL signal. When the programmable control 
with reference to FIG. 8 for accepting as inputs the input register de-asserts the DTGRUN_CTRL signal then the 
main clock (IPCLK) from the video input, the display clock eo DTGRUN output signal de-asserts to disable the DISPLAY 
(DCLK) from the display clock generator 420, and the lock TIMING GENERATOR from generating display timing, 
event pulse (LOCKEVENT) from the lock event generator When the programmable control register asserts the 
400 as well as a micro controller programming interface DTGRUN_CTRL input signal then the DTG_RUN signal 
(PROGIF) from the micro controller 150. is asserted to enable the DISPLAY TIMING GENERATOR 

The display synchronizer 410 is structurally composed of 65 to begin generating display timing, as shown in FIG. I I. 
a programmable control register 805, an adder 810, an Also when FREE RUN MODE is active, then the display 
accumulate register 825, display horizontal lock load gate synchronizer 410 does not activate the DHLOCKEVENT or 
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DVLOCKE VENT output signals. Thus, there is no synchro- input video timing initially on start up but allows the display 

nization of display video timing with the input video timing video timing to free run once started. The CLK SYNC 

by means of the display synchronizer 410 when in this MODE is useful for format conversion systems where the 

mode, as shown in both of FIGS. 11 and 12. display main clock is synlhe sized using a frequency synthe- 

CLOCK SYNCHRONIZED MODE 5 sis P nase Ioc k loop such that the resulting display frame 

DESCRIPTION timing matches the input video timing exactly. Thus, the 

The display synchronizer 410 operates in CLOCK SYNC display frame timin S fe svnchr °nized to the input video 

MODE according to the MODECTRL signal frame initiall y on start up and the display clock phase lock 

When CLOCK SYNC MODE is active, then the loo P maintains frame synchronization from that point on. 

DTGRUN GATE 835 produces the signal OTHER_„ 30 An obvious supplement to CLK SYNC MODE is the 

DTGRUN as a function of the DTGRUN_CTRL signal and capability to detect the loss of lock in the display phase lock 

the input signal LOCKEVENT. The signal OTHER_ l°op or loss of input video timing to display timing phase 

DTGRUN remains in the not active state until, firstly, the lock for the purpose of initiating re -synchronization by 

DTGRUN_CTRL signal is activated, and secondly, an means of re-starting the CLK SYNC mode or switching to 

active pulse follows on the LOCKEVENT input signal. 15 FRAME SYNC MODE (discussed in greater detail below). 

Once in the active state, the OTHER JiTGRUN signal _ 11LTr 

remains in the active state until the DTGRUN_CTRL signal LINE SYNCHRONIZED AND FRAME 

is driven to the not active state, which causes OTHER_ SYNCHRONIZED MODE DESCRIPTIONS 

DTGRUN to also return to the not active state. Thus, The display synchronizer 410 operates in one of either 

OTHER_DTGRUN is a form of DTGRUN signal that only 20 LINE SYNC MODE or FRAME SYNC MODE according 

can transition to the active state synchronous to a LOCK- to the MODECTRL signal. 

EVENX As shown in FIG. 13, when either of the LINE SYNC 

When CLOCK SYNC MODE is active, then DTGRUN MODE or FRAME SYNC MODE is active, the DTGRUN 

SELECT 850 will select the OTHER DTGRUN signal as the output signal is generated in an identical manner as CLOCK 

source for the IDTGRUN signal. IDTGRUN is then SYNC MODE, as described in detail herein above. Also, the 

re-synchronized from the input clock domain (IPCLK) to the DHLOCKLD SELECT 840 passes any detected active 

display clock domain (DCLK) by means of DTGRUN pulses on the input signal LOCKEVENT through to the 

RESYNC 865 to generate an output DTGRUN signal that is IHLOCKLD and IVLOCKLD signals which are then 

synchronous to the display clock (DCLK) for the purpose of re-synchronized from the input clock domain (IPCLK) to the 

enabling or disabling the display timing generator 430. display clock domain (DCLK) by DHLOCKLD RESYNC 

Also, when CLK SYNC MODE is active then the DHLO- 855 and D VLOCKLD RESYNC 865, respectively, to gen- 

CKLD GATE 815 holds the CLKSYNC__DHLOCKLD erate the output signals DHLO CKE VENT and 

signal in the not active state until, firstly, DTGRUN_CTRL DVLOCKE VENT, as shown in FIG. 14. 

transitions from the not active to the active state, and 35 Also, when LINE SYNC MODE is active the display 

secondly, an active pulse is detected on the LOCKEVENT synchronizer 410 synthesizes the display line rate from the 

input signal. This causes the DHLOCKLD GATE 815 to input video main clock so that the resulting output line rate 

pass the first LOCKEVENT pulse through to the follows any variations in the input video clock. Therefore, 

CLKSYNC_DHLOCKLD signal. Subsequent LOCK- the display line rate follows any variations in the input line 

EVENT pulses do not cause a CLKSYNC_DHLOCKLD 4Q ra te. LINE SYNC MODE operates with the assumption that 

while CLKSYNC_MODE remains in the active state. the input video main clock is a line locked clock such that 

When MODECTRL selects CLK SYNC MODE then the there is a constant integer number of input main clock 

DHLOCKLD SELECT 840 selects the CLKSYNC_ (IPCLK) periods for each input video line period. 

DHLOCKLD signal to pass through and drive the IHLO- The display line rate is controlled according to a rate 

CKLD signal which is then re-synchronized from the input 45 control word (INCREMENT) in the programmable control 

clock domain (IPCLK) to the display clock domain (DCLK) register. The control word provides a fractional binary value 

by DHLOCKLD RESYNC 855 to generate the output signal which is used as input to the added 810. The adder output 

DHLOCKEVENT. drives accumulator register 825 which is reset to zero 

Also, when CLK SYNC MODE is active, then the whenever a lock event occurs. The added 810 increments the 

D VLOCKLD GATE 815 holds the CLKSYNC_ 50 accumulator register 825 contents by the value contained in 

D VLOCKLD signal in the not active state until firstly, the rate control word register (INCREMENT) with each 

DTGRUN_CTRL transitions from not active to the active input main clock (IPCLK) cycle. As shown in FIG. 15, when 

state, and secondly, an active pulse is detected on the the added accumulator overflows to generate a carry out 

LOCKEVENT input signal. This causes the DHLOCKLD (CARRY_OUT) from the addition, the carry out register 

GATE 815 to pass the first LOCKEVENT pulse through to 55 820 produces a pulse on the LINES YNC_DHLOCKLD 

the CLKSYNC.J) VLOCKLD signal. Subsequent LOCK- signal which is propagated by DHLOCKLD__SELECT 840 

EVENT pulses do not cause a CLKSYNC_D VLOCKLD to drive the IHLOCKLD. The IHLOCKLD signal is then 

while CLKS YNC__M ODE remains in the active state. re-synchronized from the input clock domain (IPCLK) to the 

When MODECTRL selects CLK SYNC MODE then the display clock domain (DCLK) by DHLOCKLD RESYNC 

D VLOCKLD SELECT 840 selects the CLKSYNC_ 60 855 to generate the output signal DHLOCKEVENT. The 

DVLOCKLD signal to pass through and drive the resulting pulses of the DHLOCKEVENT output signal 

IVLOCKLD signal which is then re-synchronized from the cause the DISPLAY TIMING GENERATOR to load to a 

input clock domain (IPCLK) to the display clock domain predefined horizontal timing state within the horizontal 

(DCLK) by DVLOCKLD RESYNC 860 to generate the blanking period of the display line, 

output signal DVLOCKE VENT. 65 Therefore, the LINE SYNC MODE provides a means for 

The CLK SYNC MODE provides a means for forcing the producing a display line rate that is controlled as a fractional 

display video timing to synchronize to a lock event in the multiple of the input video main clock resulting in a display 
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line rate that follows any variations in the input video main 
clock and therefore follows any variation in the input video 
line rate. The LINE SYNC MODE also provides an appa- 
ratus and method for forcing the display video timing to 
synchronize to a lock event on a frame by frame basis. The 5 
LINE SYNC MODE is useful for format conversion systems 
where the display main clock is either free running or 
synthesized using frequency synthesis phase lock loop such 
that the resulting display frame period is similar to the input 
video frame period. In LINE SYNC MODE the display 10 
frame period need not be identical to the input frame period 
since the display synchronizer 410 forces the display frames 
to remain locked to input frames, provided that the display 
device can accommodate transients to the display timing as 
a result of the lock event. is 

The FRAME SYNC MODE provides a means for forcing 
the display video timing to synchronize to a lock event on a 
frame by frame basis. The FRAME SYNC MODE is useful 
for format conversion systems where the display main clock 
is either free running or synthesized using frequency syn- 20 
thesis phase lock loop such that the resulting display frame 
period is similar to the input video frame period. In FRAME 
SYNC MODE the display frame period need not be identical 
to the input frame period since the display synchronizer 410 
forces the display frames to remain locked to input frames, 25 
provided that the display device can accommodate transients 
to the display timing as a result of the lock event. 

DISPLAY TIMING GENERATOR DESCRIPTION 

The DISPLAY TIMING GENERATOR 330 shown in 30 
FIG. 3 comprises a Horizontal Controller as shown in FIG. 
9 and a Vertical Controller as shown in FIG. 10. 

The Horizontal Controller runs synchronous with the 
display clock, DCLK, and generates synchronization signals 35 
for controlling the display device and the format converter 
data output. The Horizontal Controller also provides a 
DHEOL signal to the Vertical Controller to indicate transi- 
tions from one display line to the next. The Vertical Con- 
troller counts display lines using DHEOL to determine the 40 
duration of the D VSYNC output signal and also generates a 
DVERTDEN signal which is used by the Horizontal Con- 
troller for generating a DEN signal. 

DISPLAY HORIZONTAL CONTROLLER 

DESCRIPTION 45 

A horizontal counter 900 counts DCLK periods. When the 
DTGRUN input signal is not active then the counter is 
disabled and held to an initial value. When the DTGRUN 
signal is active, then the counter is enabled to run. The 50 
counter is also controlled by the display horizontal end of 
line signal DHEOL generated by the DHTOTAL GEN 
Circuit 960. DHEOL is an active pulse which occurs at the 
end of each horizontal line to reset the horizontal counter to 
the start of a display line. The counter is also controlled by 55 
the DHLOCKEVENT signal which is input from the display 
synchronizer 410. DHLOCKEVENT causes the counter to 
load with the DHLOCKLD value which sets the counter to 
the display horizontal line position according to the pro- 
grammable value, DHLOCKLD. 60 

The horizontal counter 900 output is connected to a series 
of compare circuits 920, 930, 940, 950. Each compare 
circuit generates an active pulse on the compare output 
signal when the count value (DHORZCOUNT) is equal in 
magnitude to the reference value to which it is being 65 
compared. The reference values used for comparison are 
stored in programmable control register 910 which can be 



,922 Bl 

18 

programmed by means of the micro controller interface 
(PROGIF). The reference compare values are used to define 
the events which should cause the Horizontal Controller to 
produce charges to the state of the output signals. 

The sequence of operation for a horizontal display line as 
controlled by the Horizontal Controller is as follows: 
An initialization the horizontal reference compare values 
are set to predetermined values or can also be loaded by 
the external micro controller 150 with predetermined 
values corresponding to the desired display output 
format. Also, at initialization the DTGRUN signal is in 
the not active slate which forces the DHTOTAL GEN 
960, DHSYNC GEN 970, and DEN GEN 980, circuits 
to hold the Horizontal Controller outputs: DHEOL, 
DHSYNC, and DEN, in the not active state. 
When the DTGRUN input signal is driven active the 
horizontal counter 900 starts incrementing with each DCLK 
cycle. The DHSYNCGEN 970 circuit detects a DTGRUN 
input signal transition from not active to active and produces 
an active state on the DHSYNC output signal. Each DCLK 
pulse causes the horizontal counter 900 to increment by one. 
When the DHORZCOUNT is equal to the DHSYNCSTOP 
value then the comparator 930 generates an output pulse to 
the DHSYNC GEN circuit 970, which de-activates the 
DHSYNC output signal. The horizontal counter continues to 
increment. When the DHORZCOUNT is equal to the 
DHDENSTART value then the comparator 940 produces an 
output pulse. If the comparator 940 output pulse occurs 
while the DVERTDEN signal is active, then the DEN GEN 
circuit 980, activates the DEN signal. The horizontal counter 
900 continues to increment and when DHORZCOUNT is 
equal to the DHDENSTOP value then the comparator 950, 
produces an output pulse which causes the DEN GEN circuit 
to de-activate the DEN output signal. The horizontal counter 
900 continues to increment and when DHORZCOUNT is 
equal to the DHTOTAL value then the comparator 920, 
produces an output pulse which causes the DHTOTAL GEN 
circuit 960, to produce an active output pulse of the DHEOL 
signal. The active DHEOL pulse causes the horizontal 
counter 900, to reset to the start of line value. The active 
DHEOL pulse also causes the DHSYNC GEN circuit 970, 
to activate the DHSYNC output signal. 

The Horizontal Controller will synchronize to any active 
pulses of the DHLOCKEVENT input signal. An active 
DHLOCKEVENT input signal causes the horizontal counter 
900 to load with the programmable DHLOCKLD value. The 
DHLOCKEVENT (1) forces the DHTOTAL GEN 960 to 
de-activate the DHEOL output, (2) forces the DHSYNC 
GEN 970 to de-activate the DHSYNC output, and (3) forces 
the DEN GEN CCT 980 to de-activate the DEN signal. 

DISPLAY VERTICAL CONTROLLER 
DESCRIPTION 

A vertical counter 1000 counts lines by counting active 
pulses on the DHEOL signal generated by the Horizontal 
Controller. When the DTGRUN input signal is not active 
then the vertical counter 1000 is disabled and held to an 
initial value. When the DTG RUN signal is active, then the 
vertical counter is enabled to run. The vertical counter 1000 
is also controlled by the display Vertical End Of Frame 
signal DVEOF generated by the DVTOTAL, GEN Circuit 
1060. DVEOF is an active pulse which occurs at the end of 
each display frame to reset the vertical counter to the start of 
a display frame. The counter is also controlled by the 
DVLOCKEVENT signal which is input from the display 
synchronizer 410. DVLOCKEVENT causes the vertical 
counter to load with the DVLOCKLD value which sets the 
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counter to the display vertical line position according to the 
programmable value, DVLOCKLD. 

The vertical counter 1000 output is connected to a series 
of compare circuits 1020, 1030, 1040, 1050. Each compare 
circuit generates an active pulse on the compare output 5 
signal when the count value, DVERTCOUNT is equal in 
magnitude to the reference value to which it is being 
compared. The reference values used for comparison are 
stored in the programmable control register 1010, which can 
be programmed by means of the micro controller interface 10 
(PROGIF). The reference compare values are used to define 
the events which should cause the Vertical Controller to 
produce changes to the state of the output signals. 

The sequence of operation for a display frame as con- 
trolled by the Vertical Controller is as follows: 15 
At initialization the Vertical reference compare values are 
set to predetermined values or can also be loaded by the 
external micro controller 150 with predetermined val- 
ues corresponding to the desired display output format. 2Q 
Also, at initialization the DTGRUN signal is in the not 
active state which forces the DVTOTAL GEN 1060, 
DVSYNC GEN 1070, and DVERTDEN GEN circuit 
1080, to hold the Vertical Controller outputs: DVEOL, 
DVSYNC, and DVERTDEN, in the not active state. 2$ 
When the DTGRUN input signal is driven active the 
vertical counter starts incrementing with each DHEOL 
pulse. The DHSYNC GEN circuit 1070 detects a DTGRUN 
input signal transition from not active to active and produces 
an active state on the DVSYNC output signal. Each DHEOL 3(J 
pulse causes the vertical counter 1000 to increment by one. 
When the DVERTCOUNT is equal to the DVSYNCSTOP 
value then the comparator 1030 generates an output pulse to 
the DVSYNC GEN circuit 1070 which de-activates the 
DVSYNC output signal. The vertical counter continues to 35 
increment. When the DVERTCOUNT is equal to the 
DVDENSTART value then the comparator 1040 produces 
an output pulse which causes the DVERTDEN GEN circuit 
to activate the DVERTDEN signal. 

The vertical counter continues to increment and when Q 
DVERTCOUNT is equal to the DVDENSTOP value then 
the comparator 1050 produces an output pulse which causes 
the DVERTDEN GEN circuit 1080 to de-activate the DEN 
output signal. The vertical counter continues to increment 
and when DVERTCOUNT is equal to the DVTOTAL value A$ 
then the comparator 1020 produces an output pulse which 
causes the DVTOTAL GEN 1060 circuit to produce an 
active output pulse on the DVEOF output signal. The active 
DVEOF pulse causes the vertical counter 1000 to reset to the 
start of frame initial value. The active DVEOF pulse also „ 
causes the DVSYNC GEN circuit to activate the DVSYNC 
output signal. 

The Vertical Controller will synchronize to any active 
pulses on the DVLOCKEVENT input signal. An active 
DVLOCKEVENT input signal causes the Vertical Counter 55 
1000 to load with the programmable DVLOCKLD value. 
Also, the DVLOCKEVENT (1) forces the DVTOTAL GEN 
1060 to de-activate the DVEOF output, (2) forces the 
DVSYNC GEN 1070 to de-activate the DVSYNC output, 
and (3) forces the DVERTDEN GEN CCT 1080 to 6Q 
de-activate the DVERTDEN signal. 

PHYSICAL IMPLEMENTATION DESCRIPTION 

The method and apparatus described above can be imple- 
mented with discrete integrated circuits, memories, field 65 
programmable gate arrays, or other off the shelf electronic 
components. However, the preferred embodiment is a single 
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integrated circuit which contains all of the functions 
described as part of the embodiment with the exception of 
the displayed clock synthesis PLLs 730 and 740, and the free, 
running oscillator 710 shown in FIG. 7. The display clock 
synthesis PLLs are implemented using "off the shelf* 
devices such as ICS1522 and ICD2061 , and the free running 
oscillator is implemented using an "off the shelf oscillator 
device with a single clock output. 

Alternative embodiments and modifications of the inven- 
tion are possible without departing from the sphere and 
scope as set forth in the claims appended hereto. 

What is claimed is: 

1. A format converter for receiving successive input 
frames of a digital video input signal characterized by a first 
viewable display resolution, pixel rate and line rate, and in 
response generating successive output frames of a digital 
video output signal for viewing on a display characterized 
by a second viewable display resolution, pixel rate and line 
rate, said format converter comprising: 

programming interface means for receiving operating 
mode information indicative of said first and second 
viewable resolutions, pixel rates and line rates; 

memory means for storing said digital video input signal; 

display processor means for retrieving said digital video 
input signal from said memory means, performing at 
least one of de-interlacing, filtering and scaling of said 
digital video input signal, and in response generating 
said digital video output signal; and 

display timing controller means including a free-running 
display clock, aid display timing controller means 
deriving synchronization and control information from 
said digital video input signal based on said operating 
mode information received by said programming inter- 
face means, and in response controlling operation of 
said display processor means to generate said succes- 
sive output frames of said digital video output signal 
synchronous with said free-running display clock and 
frame locked to respective ones of said successive nput 
frames for display at said second viewable display 
resolution, pixel rate and line rate which is a fractional 
multiple of said first viewable pixel rate. 

2. The format converter of claim 1, wherein said display 
timing controller further comprises: 

clock generation means which incorporates said free- 
running display clock, said clock generation means 
generating a display main clock signal; 
a lock event controller for generating a lock event signal 
at a predetermined instant of each frame of said digital 
video input signal; 
display synchronizer means for generating a display hori- 
zontal lock event signal and a display vertical lock 
event signal for controlling synchronization between 
said digital video input signal and said digital video 
output signal based on said lock event signal and said 
operating mode information; and 
display timing generator means for generating timing signals 
synchronized to said horizontal and vertical lock event 
signals to control said display processor means in accor- 
dance with said operating mode information. 

3. The format converter of claim 2, wherein said clock 
generation means further comprises: 

phase lock loop means for receiving an input clock signal 
derived from said digital input video signal and in 
response generating a synthesized clock signal which is 
a ratio multiple of said input clock signal; and 

a clock selector for selecting one of said free running 
display clock or said phase lock loop as a source for 
output of said display main clock signal. 
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4. The format converter of claim 3, wherein said lock 
event controller further comprises: 

a programmable control register for generating a prede- 
termined horizontal lock event value and a predeter- 
mined vertical lock event value based on said operating 
mode information; 

a horizontal pixel event counter for counting successive 
cycles of said input clock signal relative to each of a 
succession of horizontal synchronization pulses of said 
digital input video signal and in response generating a 
horizontal pixel count value; 

a horizontal pixel event comparator for comparing said 
horizontal pixel count value with said predetermined 
horizontal lock event value, and when said horizontal 
pixel count value is equal to said predetermined hori- 
zontal lock event value then generating a horizontal 
lock event pulse; 

a vertical line counter for counting successive ones of said 
horizontal synchronization pulses relative to a succes- 
sion of input vertical synchronization pulses of said 
digital input video signal and in response generating a 
vertical line count value; 

a vertical line event comparator for comparing said ver- 
tical line count value with said predetermined vertical 
lock event value, and when said vertical line count 
value is equal to said predetermined vertical lock event 
value then generating a vertical lock event pulse; 

a lock event generator for generating a lock event pulse 
when said horizontal lock event pulse and said vertical 
lock event pulse coincide; and 

a lock event selector for selecting one of either a frame 
synchronization signal derived from said digital input 
video signal, said input clock signal, or said lock event 
pulse for output as said lock event signal based on said 
operating mode information. 

5. The format converter of claim 4, wherein said display 
synchronizer further comprises circuitry for receiving said 
input clock signal, said display main clock signal, said lock 
event signal and said operating mode information, and in 
response generating said display horizontal and vertical lock 
event signals and a run enable signal wherein: 

(i) in the event said operating mode information indicates 
a free run operating mode, the display horizontal and 
vertical lock event signals are suppressed so that there 
is no synchronization between said digital input video 
signal and said digital output video signal, and said run 
enable signal is synchronized to said display main 
clock signal for enabling and disabling said display 
timing generator; 

(ii) in the event said operating mode indicates a clock 
synchronized mode of operation, the display horizontal 
and vertical lock event signals are synchronized to said 
lock event signal initially at start up, and said run 
enable signal is synchronized to said display main 
clock signal thereafter for enabling and disabling said 
display timing generator; 

(iii) in the event said operating mode indicates a frame 
synchronized mode of operation, the display horizontal 
and vertical lock event signals are synchronized to said 
lock event signal on a per frame basis of the digital 
input video signal, and said run enable signal is syn- 
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chronized to said display main clock signal for enabling 
and disabling said display timing generator; and 
(iv) in the event said operating mode indicates a line 
synchronized mode of operation, the display horizontal 

5 and vertical lock event signals are synchronized to said 
lock event signal on a per line and per frame basis of 
the digital input video signal, and said run enable signal 
is synchronized to said display main clock signal for 
enabling and disabling said display timing generator. 

j 0 6. The format converter of claim 5 wherein said display 
timing generator further comprises: 

a horizontal controller for receiving said display main 
clock signal, said operating mode information, said 
horizontal lock event signal and said run enable signal 

15 and in response generating a horizontal end of frame 
for indicating transitions between successive lines of 
said digital output video signal, a display horizontal 
synchronization signal for driving said display, an 
output enable signal for enabling said display; and 

2 q a vertical controller for receiving said display main clock 
signal, said operating mode information, said vertical 
lock event signal, said run enable signal and said 
horizontal end of frame signal and in response gener- 
ating a display vertical synchronization signal for driv- 

25 ing said display, and a display vertical enable signal for 
application to said horizontal controller in connection 
with generating said output enable signal. 

7. The format converter of claim 1 wherein said digital 
input video signal is an interlaced signal and said digital 

30 output video signal is a progressive scan signal 

8. The format converter of claim 1 wherein said digital 
input video signal is a progressive scan signal and said 
digital output video signal is also a progressive scan signal. 

9. A display timing controller for deriving synchroniza- 
35 tion and control information from successive input frames of 

a digital video input signal which is characterized by a first 
viewable display resolution, pixel rate and line rate and in 
response controlling operation of said display processor to 
generate successive output frames of a digital video output 
40 signal for display at a second viewable display resolution, 
pixel rate and line rate different from said first viewable 
display resolution, pixel rate and line rate, comprising: 
clock generation means including a free-running display 
clock for generating a display main clock signal; 
45 a lock event controller for generating a lock event signal 
at a predetermined instant of each frame of said digital 
video input signal; 
display synchronizer means for generating a display hori- 
zontal lock event signal and a display vertical lock 
50 event signal for controlling synchronization between 
said digital video input signal and said digital video 
output signal based on said lock event signal; display 
timing generator means for generating timing signals 
synchronized to said horizontal and vertical lock event 
55 signals to control said display processor to generate 
said successive output frames of said digital video 
output signal synchronous with said free-running dis- 
play clock and frame locked to respective ones of said 
successive input frames for display at said viewable 
60 display resolution, pixel rate and line rate which is a 
fractional multiple of said first viewable pixel rate. 

* * * ♦ * 
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